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1 Abstract 

A “Monte Carlo-like” design analysis tool is de- 
veloped and applied to an aeromaneuvering Mars 
entry vehicle. This tool provides realistic but chal- 
lenging design cases using many fewer cases than 
a full Monte Carlo analysis. The problem of ran- 
dom input variables that are provided a priori (as 
opposed to being drawn from a given distribution) 
is addressed and a solution is found that shows 
prospects for future improvement. 

2 Introduction 

The engineering design of a flight vehicle is of- 
ten based on a “worst case” combination of external 
conditions and manufacturing defects which the ve- 
hicle must be able to overcome to achieve its mission. 
A better name for this case might be a “design case” , 
because a worse case can always be imagined, though 
perhaps not a realistic one. Thus, a balance must be 
maintained between designing to a case that is too 
severe, leading to overdesign (higher weight, higher 
cost) and a design case that is not severe enough and 
subjecting the vehicle to a failure that could have 
been prevented. One approach that addresses this 
issue is the use of Monte Carlo analysis as a design 
tool. In this approach, one determines a realistic 
range of values for each variable that will affect the 
final design (e.g. atmospheric dispersions, materi- 
als defects, measurement errors, etc.) and simulates 
the system with many different combinations of in- 
put variables (typically thousands.) This design 
approach has been used for the entry guidance sys- 
tem design of the Mars 2007 “Smart” Lander. 

A disadvantage of Monte Carlo design is that 
the extreme cases are the cases that drive the design. 
Typically, a system performs very well for conditions 
that are near the nominal, but not as well for con- 
ditions that are far from the nominal. For a large 


number of inputs, many cases are near the nominal, 
because relatively few cases fall far from the mean 
and of those, fewer still occur in variables that are 
strong contributors to the final output. Thus, in 
order to get a sufficient number of extreme cases, 
many thousands of Monte Carlo cases often need to 
be run. The goal of the current work is to demon- 
strate a technique for simulating extreme cases that 
are consistent with the Monte Carlo analysis, but 
requires fewer runs. 

The Monte Carlo simulation used in this study 
is similar to that described in [Striepe et al], except 
that the vehicle model has been changed to reflect 
the new mission. Notice that not all of the inputs 
have the same type of distribution. Some are Gaus- 
sian, some are Uniform and some are provided as-is 
and are not necessarily represented by any standard 
distribution. Notably the initial position and veloc- 
ity are results of another random process based on 
the interplanetary trajectory and are provided by 
the NASA Jet Propulsion Laboratory (JPL). 

3 Background 

The vehicle used in this study is the proposed 
2007 “Smart” Mars Lander. Of primary interest 
will be the portion of the mission that involves 
entry from interplanetary approach orbit until the 
parachute is deployed near Mach 2. This vehicle is a 
blunt body with a heatshield forebody very similar 
to the Viking and Pathfinder forebodies. 

The purpose of the onboard guidance system is 
to direct the vehicle safely to a predetermined tar- 
get point. The ability of the guidance system to do 
this is strongly affected by the interplanetary naviga- 
tion; that is, the accuracy with which the spacecraft 
achieves its target atmospheric entry condition. Two 
types of navigation were considered. In the first, 
the standard radiometric measurements by the Deep 
Space Network were assumed. In the second, addi- 
tional optical measurements of Phobos and Deimos 
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by the onboard star tracker are incorporated, pro- 
viding increased accuracy. The first data type is 
referred to as “radiometric” and the second as “op- 
tical” . For both types of navigation, sets of 100,000 
delivery positions and velocities were provided by 
JPL. Additionally, an estimate of the vehicles posi- 
tion and velocity as determined for use by onboard 
navigation systems was provided by JPL. 

Since Pathfinder, 1 the authors have assumed 
that 2,000 cases were adequate to characterize 
Monte Carlo results. But over the last several years, 
the simulations have become more complex and have 
more input variables. Also, as confidence in the 
methods increased, higher order statistics were uti- 
lized from the simulations. The concern is that 

2,000 cases may be insufficient for statistical anal- 
yses. Therefore, a Monte Carlo with 100,000 cases 
was run to determine the minimum number of cases 
required for reliable statistics. 

Figure 1 shows the mean true range to target 
and mean navigated range to target for the radio- 



Fig. 1 . Radiometric Mean Range to target at 
Parachute Deploy 

metric only data as a function of number of cases 
run. Both means are very well behaved and reach a 
steady state after about 15,000 cases. 

Figure 2 shows the standard deviations of range 
to target for the radiometric only data, true and nav- 
igated. These statistics are much more volatile, with 
10% changes after 50,000 cases. To some extent this 
result is to be expected, since the standard deviation 
is a higher order statistic than the mean. 

Figures 3 and 4 show the same statistics as fig- 
ures 1 and 2 but for the optical data set. Here 
the standard deviation is slightly slower to converge 
than the mean, but both are settled by 12,000 cases. 
It is not clear why the standard deviation of the op- 



Fig. 2. Radiometric Standard Deviation Range to 
target at Parachute Deploy 



Fig. 3. Optical Mean Range to target at 
Parachute Deploy 

tical data, shows so much less variability than the 
radiometric data. 

Figure 5 shows the 99.7% range for the two nav- 
igation types, again as a function of number of cases. 
The difference between the two navigation types is 
even more pronounced for this statistic. The radio- 
metric takes 50,000 cases to converge within 10% of 
the final result while the optical is within 2% from 

2.000 cases on. In the runs using radiometric data, 
the initial vehicle state is a much larger contributor 
to the range than for the optical data. It has been 
conjectured that the larger variation in the initial 
state values may contribute to the slow convergence 
of the radiometric data. 

Not knowing the reason for the slow conver- 
gence, a conservative approach would require at least 

60.000 cases to estimate the standard deviation of 
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Fig. 4. Optical Standard Deviation Range to 
target at Parachute Deploy 



Number of Monte Carlo Cases x io‘ 

Fig. 5. 99.7% Range to target at Parachute 
Deploy 

the final range. 

4 Robustness Simulation 

As a final check, a 60,000 case Monte Carlo 
simulation might be acceptable for a three degree- 
of-freedom (3DoF) problem. As a design tool, a 
60,000 cases run is not practical with current com- 
puters. Fortunately a design tool need not estimate 
the standard deviation or 99.7% range values. Since 
the design is driven by the most severe cases, it is 
only necessary to simulate those cases. 

The current approach is “Monte Carlo-like” in 
that it is based on random values for key simulation 
parameters. The distributions of the random inputs 
are modified so that the most extreme realistic cases 
result. For the normally distributed variables, only 


values more than 2 a from the mean are used. For 
uniform variables, only the endpoints of the distri- 
bution were used. In this manner, extreme (but 
reasonable) combinations of parameters were inves- 
tigated. These extreme values of inputs are referred 
to as “robust” inputs. 

Since the initial states were provided as-is and 
not generated from a known distribution, it was nec- 
essary to select an appropriate set from the 100,000 
states available. A set of 2,000 cases was chosen, 
made up of five distinct subsets. The first subset 
consisted of the 400 states with the largest position 
delivery errors. The second subset consisted of the 
400 states with the largest velocity delivery errors. 
The third subset consisted of the 400 states with the 
largest position knowledge errors. The fourth subset 
consisted of the 400 states with the largest velocity 
knowledge errors. The final subset consisted of the 
400 states with the largest sum of absolute value 
of the error in each of the 12 state components (3 
position, 3 velocity, 3 knowledge position, 3 knowl- 
edge velocity). That is, while the first four subsets 
were vector magnitudes, the fifth subset summed the 
absolute value of each component of the other four 
vectors. This fifth subset is referred to as the 12- 
state magnitude error subset. 

There is considerable correlation between the 
five subsets. From the radiometric data 68 states 
occurred in only one subset, 447 states occurred in 
exactly two subsets and 346 states occurred in ex- 
actly 3 subsets, for a total of 861 different states used 
in the 2,000 runs. Figures 6 and 7 show the delivery 
latitude and longitude of the 100,000 states and the 



True Longitude (deg) 


Fig. 6. Initial Distribution of 100,000 radiometric 
states and robust states. 

861 selected. The endpoints of the 100,000 states 
are included (usually multiple times) in the reduced 
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Fig. 7. Initial Distribution of robust radiometric 
states by subset. 

set. 

The states chosen from the optical data over- 
lapped as well. They included 240 states in exactly 
one subset, 532 states that occurred in exactly two 
subsets, 229 in exactly three subsets, 1 in exactly 
four subsets and 1 in exactly five subsets, for a total 
of 1,003 different states. Figures 8 and 9 show the 
distribution of the 100,000 optical states and of the 
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Fig. 8. Initial Distribution of 100,000 Optical 
states and robust states. 

1,003 selected initial states. 

Figures 10 and 11 cover the navigated super- 
sonic parachute deploy condition for the 100,000 
case Monte Carlo simulation and the 2,000 case ro- 
bustness study, respectively. Note that the simula- 
tion (exterior to the guidance) forced the parachute 
to deploy whenever the navigated altitude dropped 
below 6 kilometers, while the guidance attempted to 
keep the parachute deployment within Mach and dy- 


Fig. 9. Initial Distribution of robust Optical states 
by subset. 



Nav Relative Velocity (m/sec) 


Fig. 10. Radiometric Navigated Conditions at 
Supersonic Parachute Deploy; 100,000 Monte Carlo 
cases. 

na.mic pressure limits by constraining the parachute 
deployment to occur at velocity between 370 and 503 
m/s.. The footprint of the two studies are very simi- 
lar. The robustness study resulted in more cases out- 
side of the allowable Mach/Dynamic pressure box. 
This result is due to the more severe atmosphere in 
the robustness runs, which was always at either its 
thinnest or thickest value. Notice the banded struc- 
ture in the Nav Altitude vs. Nav Velocity plot. This 
banding will be even more evident in the optical nav- 
igation runs and will be discussed later. Figures 12 


4 





18 , 



4 I 1 1 1 1 1 1 1 1 

350 400 450 500 550 600 650 700 750 

Nav Relative Velocity (m/sec) 


Fig. 11. Radiometric Navigated Conditions at 
Supersonic Parachute Deploy; 2,000 Robust cases. 

and 13 show the actual values to match the navi- 
gated values in figures 10 and 11. 
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Fig. 12. Radiometric True Conditions at 
Supersonic Parachute Deploy; 100,000 Monte Carlo 
cases. 


18 l 


16k 



4 1 1 1 1 1 1 1 1 

350 400 450 500 550 600 650 700 750 

True Relative Velocity (m/sec) 


Fig. 13. Radiometric True Conditions at 
Supersonic Parachute Deploy; 2,000 Robust cases. 
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Figures 14 and 15 are similar to the preceding 
charts, but cover the optical states studies. Again 
the results are very similar between the 100,000 cases 
and the 2,000 cases, though the robustness cases 
have more cases that exceed the parachute deploy 


Fig. 14. Optical Navigated Conditions at 
Supersonic Parachute Deploy; 100,000 Monte Carlo 
cases. 
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Fig. 15. Optical Navigated Conditions at 
Supersonic Parachute Deploy; 2,000 Robust cases. 

Mach limit. In figures 16 and 17, which show the 
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True Relative Velocity (m/sec) 

Fig. 16. Optical True Conditions at Supersonic 
Parachute Deploy; 100,000 Monte Carlo cases. 

true altitude and velocity at parachute deploy, the 
banded structure is very distinct. The banding oc- 
curs because the altitude and velocity at parachute 
deploy are largely determined by two factors: the at- 
mospheric density and the hypersonic axial force co- 
efficient. For this mission the effect of the two factors 
is approximately equal and in the robust case study, 
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Fig. 17. Optical True Conditions at Supersonic 
Parachute Deploy; 2,000 Robust cases. 

each factor was either at its maximum or its min- 
imum. When a high density atmosphere combined 
with a high axial force coefficient, the parachute de- 
ploy was high and slow. When both factors were 
low, the deploy was low and fast, and when one was 
high and the other low, the result was in the mid- 
dle. This effect is clear from figures 18 and 19 which 
discriminate between high and low values for each 


EMQ Robust Cases - Radiometric + Optical - 02-Feb-2001 
Supersonic Chute Deploy 



Fig. 18. Conditions at Parachute Deploy sorted 
by Axial Force Coefficient. 

of the factors. Notice that all of the cases with high 
atmospheric density and high axial force coefficient 
are on the upper left, all cases with low for both are 
in the lower right and in the middle each case is low 
in one and high in the other. 
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Fig. 19. Conditions at Parachute Deploy sorted 
by Atmospheric Density. 

Prior to the Monte Carlo study, success crite- 
ria were established to determine what constituted a 
“safe” landing. The maximum safe landing vertical 
velocity was 4 m/s and the maximum safe landing 
horizontal velocity was 2 m/s. According to these 
criteria, 180 cases in radiometric and 175 cases in op- 
tical failed the 100,000 case Monte Carlo, while 199 
cases in radiometric and 132 cases in optical failed 
the robustness study. 

5 Postmortem and Future 

The means of state selection described above 
was considered ad hoc. In an effort to make the state 
selection process better, the footprint and parachute 
deploy conditions for the robustness study were bro- 
ken into subsets corresponding to the initial con- 
dition subsets. The segregated footprint is shown 
in figure 20. It is clear that all of the very long 
cases and most of the very short cases resulted from 
states in the 12-state magnitude subset. Figure 21 
shows the parachute deploy conditions similarly seg- 
regated. Here all five subsets contribute to the 
out-of-bounds cases which are driven largely by the 
atmosphere. But the 12-state magnitude states seem 
to cover the range of out-of-bounds cases. Figures 22 
and 23 show the same results for the optical cases. 
In the footprint shown in figure 22, there is more 
of a mixture of subsets in the very long and very 
short cases, but most seem to be from knowledge 
errors and 12-state errors. This result is due to the 
much smaller state errors for the optical cases, so the 
knowledge errors become the dominant factor and 
the 12-state errors include the knowledge errors. Fi- 
nally, figure 23 shows the deploy condition for the 



Fig. 20. Radiometric Footprint broken down by 
initial state subset. 
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Fig. 21. Radiometric Parachute Deploy 
Conditions broken down by initial state subset. 

optical cases. Here almost all of the out-of-bounds 
cases are either knowledge or 12-state. 

Figures 20 through 23 show that the 12-state 
magnitude errors show up consistently in the ex- 
treme cases. Suggesting that this method may be 
a way to select states for future robustness studies, 
perhaps with some weighting of the various compo- 
nents to find the most effective states. 

Another issue is whether the endpoint of a uni- 
form distribution is the worst possible input when 
it is combined with other inputs. This issue is espe- 
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Fig. 22. Optical Footprint broken down by initial 
state subset. 
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6 Conclusions 

The number of runs needed for a full Monte 
Carlo analysis has been found to be much too large 
for its use as a design tool for planetary entry prob- 
lems. A “Monte Carlo-like” design analysis tool has 
been developed and applied to a Mars entry vehi- 
cle. This tool provides realistic but challenging de- 
sign cases using many fewer cases than a full Monte 
Carlo analysis. The problem of random input vari- 
ables that are provided a priori (as opposed to being 
drawn from a given distribution) has been addressed 
and a solution was found that shows prospects of fu- 
ture improvement. 
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Fig. 23. Optical Parachute Deploy Conditions 
broken down by initial state subset. 


dally a concern for the atmosphere where a very 
complicated, non-linear system has been parame- 
terized by a single factor, the atmospheric opacity. 
In the future studies we will replace the endpoints 
of the uniform variables with “V” -distributed vari- 
ables. That is, variables that have 0 probability of 
occurring at the midpoint and linearly increase in 
probability away from the midpoint. 
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